How to rate the quality of an analytic report? Here's a "badge card" summary version of one set of criteria from a decade or two ago, followed below by a long-form version.
Badge Card
| Message | Analytic | Convincing | Structured | Well-Written |
| Main Point Clear | Judgments, Not Just Facts | Evidence for Judgments | Sections Advance Story | Precise Language |
| Beyond the Obvious | Provide Context | No Contradictions | One Point per Section | Concise |
| "So What?" | Anticipate Questions | Explain Reliability | Consistent Tics | No Typos |
| Note Changed Assessment | Alternate Views | Free of Bias | No Redundancy | No Awkward Constructions |
| Opportunities for the US | Forward Looking | Identify Gaps | Graphics Aid Text | |
| Provide Warning | Confidence Levels |
key:
- Essential
- Desired
- As Appropriate
Long Form
Message Analytic Convincing Effectively Structured Well-Written Main point prominent and clearly stated Makes judgments; does not just provide facts Provides sufficient and compelling evidence to support judgments Each section, paragraph, and sentence advances the story Uses precise language, employing concrete examples and avoiding vague, ambiguous terms and jargon Main point goes beyond what is obvious to a generalist Provides necessary context: key drivers; appropriate historical context; comparisons that provide perspective scale; whether development is new or consistent with ongoing trend Free of actual or apparent contradictions (to include consistency between title, summary, text, scope note, background note) One main point per section, per paragraph Is concise Main point has a "so what?" for the US Anticipates a critical reader's questions and answers them in the text Reliability of information clearly articulated (e.g., corroboration, access) Tics are consistent with the paragraphs to which they are attached Free of grammatical errors, typos, and misspellings If change from previous analytic line, explains what factors changed that resulted in amending the previous judgment Makes differing views/alternative explanations clear, providing basis and implications of the difference Free of bias, value laden terms, or advocacy Avoids redundancy, groups like with like Avoids awkward constructions Provides opportunities for the U.S. Is forward looking Identifies gaps, potential impact on the analytic line, and efforts to fill them Contains graphics that effectively complement the written product Provides warning Expresses confidence level in judgment
key:
- Essential
- Desired
- As Appropriate
(cf I Am the Very Model of a Modern Intel Analyst (2018-04-08), How to Share Hard Ideas (2021-04-12), ...) - ^z - 2023-11-04